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1.  Summary . The  following  theorem  is  proved. 

Let  X^ , X2 , Xn  be  n independently  (but  not  necessarily 

identically)  distributed  random  variables , and  assume  that  the 

n^b  moment  of  each  X^  (i  = l,2,...,n)  exists.  The  necessary  and 

sufficient  conditions  for  the  existence  of  two  statistically 

n n 

independent  linear  forms  Yi  = 2 a X0  and  Y0  = 2 b^Xo  are: 

1 3=1  3 3 2 S=1  3 3 

(A)  Each  random  variable  which  has  a nonzero  coefficient 
in  both  forms  is  normally  distributed. 

(B)  2 asbsof  = 0 . 

s=l 

2 

Here  os  denotes  the  variance  of  Xs  (s  = l,2,...Jln). 

For  n=2  and  ap=b]_=a2=l , b2=-l  this  reduces  to  a theorem 
of  S.  Bernstein  [1]  (see  also  [3])  which  was  also  proved  by 
M.  Kac  [[(.]  in  measure  theoretic  terms.  Another  particular  case 
of  the  theorem  is  stated  without  proof  in  a recent  paper  by 
Yu.  V.  Linnik  [5]  . 

2.  Introduction.  We  consider  two  linear  forms 

(1)  Y]_  = 2 asXs  ; Y 2=2  bsX 

s =1  s =1 

in  the  n independently  distributed  random  variables  X-^  ,X2  , * ’ * >Xn« 
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We  arrange  the  variables  so  that  the  first  p (X-^  , * * 0 ,X  ) have 

nonzero  coefficients  in  both  forms  and  the  remaining  (n-p) 

have  zero  coefficients  in  one  form  or  the  other.  Clearly 

0 ^ p < n.  When  p=0 , Y-j_  and  Y£  are  trivially  independent;  when 

p=l , Y]_  and  Y2  cannot  be  independent.  For  p ^ 2,  it  is  clear 

that  the  statistical  independence  of  the  original  linear  forms 

(1)  is  completely  equivalent  to  the  independence  of  the  forms 
P P 

Zl  = 2 asXs  and  ^2  = 2 bsXg.  This  means  that  when  p < n 

s=l  s=l 

the  distributions  of  the  random  variables  Xp+]_ , ••••  ,Xn  do  not 
affect  the  independence  of  Y]_  and  Y2 . This  is  why  the  theorem 
contains  only  a statement  about  the  distributions  of  those  random 
variables  with  nonzero*  coefficients  in  both  forms. 

If  for  some  pairs  of  corresponding  coefficients,  say  the 
first  r (l<r<p),  the  relation 


(2) 

holds,  then  we 


fl  = f2  _ ...  = fr 

bi  b2  br 

can  rewrite  Z]_  and  Z2  as 


C 


Zx  = C(bxXx  + - ••+brxr)  + ar+1Xr+1  + "*+apXp  , and 
Z2  = b1X1  + ---+brXr  + br+iXI,+1  + '"+bpXp 

Introducing  the  new  variable  X-j_  = b]_X]_  + * • •+br».Xr  , we  see  that  the 
independence  of  Y-j_  and  Y 2 is  equivalent  to  the  independence  of 
the  forms  Z1  = CX-L  +ap  +1Xr+1+*  • • +apXp  and  Z2  = xl+br+iXr+l  + ° ° ° +b 
If  the  theorem  holds  for  the  forms  Z ^ and  Z2>  Cramer's  theorem  [2] 
shows  that  the  normality  of  X]_  implies  the  normality  of  the 
random  variables  X]_  ,X2»  • • • ,Xr  . We  proceed  in  the  same  manner  if 
there  are  several  groups  of  random  variables  for  which  a relation 
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of  type  (2)  holds.  Hence  out  problem  reduces  to  the  study  of 
the  independence  of  two  linear  forms  whose  coefficient  matrix 


contains  no  vanishing  minor  or  order  2. 

Finally  it  is  clear  that  the  independence  of  Yq_  and  is 

n 

equivalent  to  the  independence  of  the  forms  Y]_  = Z a (XS-E[XS]) 

~ n s=l 

and  Y0  = 2 b (X  -E  [X-  ] ) . Therefore  we  shall  assume  without 

d s=l  S S 

loss  of  generality  that  the  following  conditions  are  satisfied: 

(i)  asbs  t 0 (s  = 1,2,. . . ,n) 

(ii)  agbt-  £ 0 for  all  s =(=t  (s,t  = 1,2,.. ,,n) 

(iii)  E [Xs ] = 0 (s  = 1,2, ...,n) 

• 

3 • The  functional  equation  for  the  characteristic  functions. 

Denote  the  distribution  function  of  the  random  variable  Xs  (s=l,...,n) 
by  Fs(x)  and  the  corresponding  characteristic  function  by  fs(t). 

Let  h(u,v)  be  the  c.f.  of  the  joint  distribution  of  Y]_  and  Y 2 and 
write  h]Ju)  = h(u,0),  h^v)  = h(0,v).  Clearly  h-^(u)  and  h-2(v) 
are  the  c.f.'s  of  the  distributions  of  Y-^  and  Y2 , respectively. 

We  prove  first  that  our  conditions  are  necessary;  that  is, 
we  assume  that  Y^  and  Y 2 are  statistically  independent.  In  terms 
of  characteristic  functions  this  means 


(3) 


h(u,v)  = h]_(u)h2(v) 


Further,  because  X-j_ , 

(k) 


hX ( u)  = "T T fs(asu)  » 


• • • ,Xn  are  independent,  we  have 


# • • 


n 


S=1 


n 


(5) 


^2  ( v>  = TT  fs(bsv) 


S=1 


n 


h(u,v)  = IT"  fs(asu+bsv) 


s=l 


(6) 
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Finally,  substituting  (4),  (5>)  » and  (6)  , in  (3)  we  obtain  the 
following  functional  equation  in  the  characteristic  functions: 

(7)  TT  fs(asu+bsv)  = "T T fs(asu)fs(bsv)  • 

s=l  s=l 


4.  The  differential  equations  for  the  cumulant  generating  functions. 
The  general  procedure  for  determining  the  explicit  form  of  the 
characteristic  functions  fg(t)  will  be  to  differentiate  the 
logarithm  of  (7)  r times  (r  = l,2,...,n)  with  respect  to  u, 
set  u=0 , and  solve  the  resulting  n differential  equations  for 
In  fs(t)  (s  = 1,. .. ,n) . 

We  first  note  that  fs(o)  =1  ( s = l,...,n)  and  that  fs(t) 

is  a continuous  function  of  t.  Therefore  there  exists  a neighbor- 
hood of  the  origin  in  which  all  the  factors  occuring  in  (7)  are 
different  from  zero.  This  neighborhood  could  of  course  be  the 
entire  plane.  In  the  following  derivation  we  restrict  the  values 
of  u and  v to  this  neighborhood;  then  we  may  take  the  logarithm 
of  both  sides  of  (7)  and  obtain 

n n n 

(9)  Z ^s(agu+bsv)  = 2 ^s(asu)  + 2 ^s(bgv)  , 

s=l  s=l  s =1 


where  /s(x)  = in  f^(x) 
Differentiating  (9)  r times  with  respect 

n 

(10)  2 

s=l 


/ (suu+b-v) 


u=0 


to  u and  setting  u=0  yields 


n 

= 2 
s=l 


dur 


(a3U) 


J u=0 


Letting  Z3  = agu,  we  find  that  the  typical  term  on  the  left  side 
of  (10)  becomes 


" 


■ ' ■'  , 
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(11) 


4(asu+bsv) 


= a. 


u=o 


zs=0 


Employing  the  substitution  lfs ( v)  = /(b  v),  (11)  becomes 


(12) 


r ^s(asu+bsv) 


= ftl\  il  f ( v) 

u=0  y°s)  dvr  3 


Similarly  the  typical  term  on  the  right  side  of  (10)  becomes 


(13) 


,(s) 


dur  ^s(asU) 


u=0 


z„=0 


(ias) 


.1  s 


where  1 is  the  rtb  order  cumulant  of  Xs • Substituting  (12) 
and  (13)  in  (10)  we  obtain 

Z -^r  lJs(v)  = 2 (ias)VS> 


dU) 


S=1 


dv 


3=1 


(r  1,2,... ,n) 


where  Is  = e| 


Differentiating  (14)  (n-r)  times  yields  the  system  of  differen- 

tial equations 


(15) 


n 

Z 

S=1 

f 

Js 

dn 

dvn 

n 

Z 

tn 

dn 

s=l 

-^s 

dvn 

(r  = 1,2,... ,n-l) 


n 


We  have  to  determine  all  the  distribution  functions  whose  charac- 
teristic  functions  satisfy  this  system  of  differential  equations 
and  the  initial  conditions 

,r 


(15a) 


d 


dv2 


v=0 


= ub  jr/s) 

' s r 


r = 1,2,... ,n-l 


ts(0)  = 1 


V 


We  now  define 
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Dn  = 


'*1 

If 

ll 


n 


S2 


• • • • • 


C 

j n 


th 


column 


and  denote  by  D„  the  cofactor  of  the  element  in  the  s 
J s ,n 

and  the  n^*1  row  of  Dn.  Considering  (If?)  as  a system  of  n linear 

,n 

equations  in  the  quantities  — S.._  ljj  (v),  we  obtain  the  solutions 


dvn 


(16) 


dR  Hr 
dvn 


D. 


(v)  = 2 (ia0)n/fis)  = inC 


say 


;n  s=l  “ s’n 

Integrating  (16)  n times  and  employing  the  initial  conditions 
(l£a)  yields 

n-1  (ibq)^*  / q \ _•  6S  n ~ 

= ~TT~  vJ  + ~?r  (iv)  • 

Since  f (bgv)  = exp[^  (bgv)]  = exp[l|js(v)]  we  have 


(17) 


f q ( b a v ) = exp 


(s) 


n-1  K 
2 -JL- 

j=l  j 


(ibv)‘  + -3^  <ibsv) 


n 


bsnl 


In  case  any  of  the  functions  f (t)  become  zero  for  some 

s 


real  t,  this  solution  is  valid  only  in  a certain  neighborhood 
of  the  origin.  We  next  show  by  an  indirect  proof  that  none  of 
the  functions  fs(t)  (s  = l,...,n)  has  a real  zero;  from  this 
we  can  conclude  that  (17)  is  valid  for  all  real  t. 

Let  us  therefore  assume  that  one  or  more  of  the  c.f.’s 
fs(t')  have  zeros.  In  this  case  at  least  one  of  the  functions 
fs(b  v)  will  have  a zero.  Denote  by  v£  the  zero  closest  to  the 


. iv 


- 

■ 
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origin  and  by  fr,(t)  a function  for  which  f^b^v^)  = 0.  For 


| v | < |v°|  we  have  fs(bsv)  £ 0 (s  = l,...,n)  and  formula  (17) 
is  valid.  Let  v be  a real  number  such  that  |v|  < |v°[;  then  we 


have  by  (17) 

(18)  fp(brv)  = exp 


n_1  i Cr  n n 

Z -A—  (ib  v)J  + (ib  v) 

j=l  3 1 bjnl  r 


But  f (t)  is  a continuous  function.  Hence  1^  o f.„(b  v)  = 


v; 


= fr(t>rv°)  = 0 by  assumption.  However,  from  (18)  it  is  clear  that 


v 


11^vo  fr (brv)  = exp 


n-1  *(n) 

2 


(ibA°)J  + ^ (ib  v°) 

r r bnn«.  r r* 


n 


3=1  3 

which  is  always  different  from  zero.  This  is  a contradiction,  and 

hence  formula  (17)  is  valid  for  all  values  of  v.  Writing  t = bev 

s 

we  finally  obtain 


(19) 


f (t)  = exp 


n-1  *(s) 

2 _J 

3=1  3 1 


(it) 


's  ,n . 


bsnl 


(it) 


n 


5.  Proof  of  the  theorem.  We  have  determined  all  the  solutions 
of  the  system  (15)  satisfying  the  initial  conditions  (15a)  . In 
order  to  find  the  distribution  functions  whose  characteristic 
functions  satisfy  this  system  we  must  select  those  functions  (19) 
which  are  characteristic  functions.  This  is  easily  done  by  means 
of  the  following  result  due  to  Marc inkiewicz  [6], 

Theorem  of  Marclnkiewicz . 

a0+a-i  z + . . .+arzr 

No  function  of  the  form  e (r>2)  can  be 

a characteristic  function. 

Hence  the  degree  of  the  polynomial  in  (19)  cannot  exceed  2.  In 


'/ 


”J&  O'.E 


> . ■,  . ■ ' - ■ : . : • 

r : : 


case  n>2  we  must  have 
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A. 


(s)  = 


0 


Cs,n  = 0 

Do  n 

Because  the  factor  -zs— 

D, 


n 


reduce  to 


j = 3,4, • • • ,n-l;  s = 1 ,2 , . . . ,n  (n >3) 

(n>2) ; s = 1,2, . • . ,n 

is  C cannot  vanish,  these  relations 
s ,n 


(20)  AjS>  =0  j = n>3 

2 ag/f^S^  = 0 n>2  . 

s=l  3 n 

There  is  no  restriction  if  n = 2.  In  view  of  (iii)  = 0 also, 

and  (19)  becomes 


(21) 


fs(t) 


exp 


2 

o 

s 


for  n > 2 . 


This  shows  that  each  X (s  = l,...,n)  must  be  normally  distri- 

s 

buted,  which  is  condition  (A)  of  the  theorem.  All  cumulants  of 
order  r>2  vanish  for  a normal  distribution,  hence  equations  (20) 
impose  no  additional  restrictions.  In  case  n = 2 we  have 


for  n = 2 , 

where  k is  determined  from  (16)  and  (19).  The  independence  of 

Y-^  and  implies  that  they  are  uncorrelated  which  yields  condition 

(b)  and  completes  the  first  part  of  the  proof. 

It  is  easy  to  establish  that  conditions  (A)  and  (B)  are  also 
sufficient.  Assuming  that  (A)  and  (B)  hold,  it  follows  that 
Y]_  and  Y£  are  uncorrelated  and  normally  distributed.  Hence  Y-^ 
and  Y2  must  be  independent. 


(22) 


fs(t)  = exp 


-k/2  t2 


: 1 

. 


\ ' ■ 


; > 


■ ' . ■ ■%.  ' 'i 


V :■  ■; 


,9 


/ ' , 
5 


•■■■■  - , 

• : ..  ..  ..  . -i  ' ■ ■ ?' 

- 


‘f  i 
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For  n = 2 and  ai  = 8. ^ = = 1,  b£  = -1  we  obtain  from  (22) 

,2 


f„(t)  = exp 


o\  + o| 


s = 1 ,2 


This  shows  that  and  establishes  Bernstein’s  theorem. 
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